iteration-saturation-huge-reorder/specs-cold-btreemap/1

PDF of Slope Regression

Additional Statistics:

Lower bound Estimate Upper bound
Slope 1.5696 us 1.6159 us 1.6600 us
0.8879260 0.9103096 0.8899184
Mean 1.5631 us 1.5998 us 1.6383 us
Std. Dev. 70.176 ns 97.857 ns 117.36 ns
Median 1.5416 us 1.5714 us 1.6524 us
MAD 45.007 ns 116.49 ns 150.38 ns

Additional Plots:

Understanding this report:

The plot on the left displays the average time per iteration for this benchmark. The shaded region shows the estimated probabilty of an iteration taking a certain amount of time, while the line shows the mean. Click on the plot for a larger view showing the outliers.

The plot on the right shows the linear regression calculated from the measurements. Each point represents a sample, though here it shows the total time for the sample rather than time per iteration. The line is the line of best fit for these measurements.

See the documentation for more details on the additional statistics.

Change Since Previous Benchmark

Additional Statistics:

Lower bound Estimate Upper bound
Change in time -3.4711% -0.9563% +1.6924% (p = 0.48 > 0.05)
No change in performance detected.

Understanding this report:

The plot on the left shows the probability of the function taking a certain amount of time. The red curve represents the saved measurements from the last time this benchmark was run, while the blue curve shows the measurements from this run. The lines represent the mean time per iteration. Click on the plot for a larger view.

The plot on the right shows the two regressions. Again, the red line represents the previous measurement while the blue line shows the current measurement.

See the documentation for more details on the additional statistics.